Computer Generated Imagery (CGI) Fault Clearance Instructions

ABSTRACT

A method of providing instructions to a user of an imaging device includes generating a three-dimensional (3D) model of the imaging device in a 3D computer generated environment. At least one computer generated imagery (CGI) instruction sequence is then rendered from the 3D model. The CGI instruction sequence depicts at least one action being performed on the imaging device and is rendered from a virtual viewpoint corresponding to a viewpoint of a user physically performing the at least one action. The rendered CGI instructions are stored in memory of the imaging device and selectively displayed on a user interface display screen of the imaging device.

PRIORITY CLAIM

This application is a divisional application of and claims priority toU.S. patent application Ser. No. 12/417,728, which was filed on Apr. 3,2009, is entitled “Computer Generated Imagery (CGI) Fault ClearanceInstructions,” and which will issue as U.S. Pat. No. 8,135,299 on Mar.13, 2012.

TECHNICAL FIELD

This disclosure relates generally to imaging devices, and, inparticular, to devices and methods for clearing faults in such imagingdevices.

BACKGROUND

Imaging devices require a user's active participation in connection withoperations. The extent of required participation differs, depending onthe type of device. One type of operation involves setup procedures.These can include setting various default conditions, selecting optionsfor a particular job such as paper size or orientation, colorcalibration steps, entering source or destination information, andvarious other selections. A different kind of operation thatadvantageously relies on actions by the user may involve diagnostic andfault recovery procedures, namely identifying, isolating and correctingoperational problems, a familiar example being the clearing of paperjams. A third type of operation may concern regular maintenanceprocedures such as changing supplies of ink, toner or other markingmaterial, cleaning print heads and paper paths, etc.

Help screens have long been employed to provide direction to a user insetting up the device, handling regular maintenance, and responding tofaults. Sensed deficiencies in initial condition, and operational faultsduring printer operation, advantageously generate an alarm and may alsopresent information on the nature and location of the fault to assistthe operator in remedying faults, if possible. In some previously knownsystems, instructions for clearing faults in an imaging device were inthe form of text messages indicating the source of the fault and/or oneor multiple still images depicting the section of the device in need ofattention that were provided, for example, on the exterior surface ofthe imaging device or on a user interface display screen. Still imageswere presented to the user comic strip style or presented one afteranother (e.g., in gif format). While still images may be sufficient forsimple faults such as an out-of-paper condition, they may not beadequate for more complicated faults such as a paper jam. Clearing sucha fault may require multiple steps such as: opening a door, turning alever clockwise, pulling out a mechanism, lifting a cover, etc. Such asequence of steps is difficult for an operator to follow even whenmultiple still images are provided to illustrate each step because theimages do not convey information about the movements required toaccomplish the task.

Another approach that has been utilized to provide instructions to anoperator is the use of live-action videos depicting an operatorinteracting with the imaging device in a prescribed manner intended toremediate, or clear, the fault condition. Live-action instructionalvideos may be effective in assisting an operator in interacting with animaging device. However, in considering the use of live-action footagefor directing users in interacting with an imaging device, a number ofissues were found that made the use of live-action videos unwieldy andexpensive. For example, the production of live-action videos may beexpensive due to the multiple people, e.g. actors, camera people, etc.,the use of a particular locale, pre-production tasks such asstory-boarding, filming the video, post-production tasks such asediting, that are involved. In addition, as an iterative process, whereinstruction is story-boarded, a sequence is produced, implemented andthen validated in usability testing, changes are likely to be made to aninstruction after the initial delivery—to refine and enhance the clarityof the instruction based on user feedback. The use of live action videowould require that the entire instruction be recreated in order toaccount for changes in fault clearance methodology. In addition, thereare many details of imaging device operation that are not easilycaptured in a live-action video, such as the way baffles snap open, orcrash down, renditions of media, such as paper, and how it crumples, forexample. Thus, live-action videos may still have to undergo significantediting after the video has been captured to add graphical overlays andthe like to the videos so that a user can understand what's going on thevideo and be able to follow its instructions.

SUMMARY

As an alternative to using still images or live-action video forproviding instructions to a user of imaging device, the presentdisclosure proposes the use of computer generated imagery (CGI)instructions for guiding a user's interactions with an imaging device.In one embodiment, a method of providing instructions to a user of animaging device includes generating a three-dimensional (3D) model of theimaging device in a 3D computer generated environment. At least onecomputer generated imagery (CGI) instruction sequence is then renderedfrom the 3D model. The CGI instruction sequence depicts at least oneaction being performed on the imaging device and is rendered from avirtual viewpoint corresponding to a viewpoint of a user physicallyperforming the at least one action. The rendered CGI instructions arestored in memory of the imaging device and selectively displayed on auser interface display screen of the imaging device.

In another embodiment, a fault management system for use with an imagingdevice is provided. The fault management system includes a memory and aplurality of computer generated imagery (CGI) instruction sequencesstored in the memory. Each CGI instruction sequence is rendered from a3D model of an imaging device defined in a 3D computer generatedenvironment and depicts at least one action being performed on theimaging device. Each CGI instruction sequence is rendered from a virtualviewpoint in the 3D environment corresponding to a viewpoint of a userphysically performing the corresponding action. The system also includesa user interface display screen operably coupled to the memory andconfigured to selectively display the plurality of CGI instructionsequences.

In yet another embodiment, a method of operating an imaging device isprovided. The method comprises detecting a fault condition in an imagingdevice; and displaying at least one CGI instruction sequence on adisplay screen in response to the detection of the fault condition. EachCGI instruction sequence is rendered from a 3D model of an imagingdevice defined in a 3D computer generated environment and depicts atleast one action being performed on the imaging device. Each CGIinstruction sequence is rendered from a virtual viewpoint in the 3Denvironment corresponding to a viewpoint of a user physically performingthe corresponding action.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing aspects and other features of the present disclosure areexplained in the following description, taken in connection with theaccompanying drawings, wherein:

FIG. 1 is a schematic diagram of an embodiment of an ink jet printingapparatus.

FIG. 2 is a block diagram of the fault management system of FIG. 1.

FIG. 3 is a flowchart of a method of generating CGI fault clearanceinstructions for the fault management system of FIG. 2.

FIGS. 4A-C are still images from a CGI instruction for removing jammedmedia from an imaging device.

FIG. 5 is a still image from a CGI instruction for loading a yellow inkstick into the imaging device of FIG. 1.

FIG. 6 is a still image from a CGI instruction for handling a waste inktray of the imaging device of FIG. 1.

FIG. 7 is a still image from a CGI instruction for loading a black inkstick depicting a CGI hand performing the loading.

FIG. 8 is a still image from a CGI instruction showing a CGI handremoving and replacing a staple cartridge.

FIG. 9 shows a user interface displaying a fault frame having a 3Cgraphics window for displaying a CGI instruction and an accompanyingtext window.

DETAILED DESCRIPTION

For a general understanding of the present embodiments, reference ismade to the drawings. In the drawings, like reference numerals have beenused throughout to designate like elements.

As used herein, the terms “printer” or “imaging device” generally referto a device for applying an image to print media and may encompass anyapparatus, such as a digital copier, bookmaking machine, facsimilemachine, multi-function machine, etc. which performs a print outputtingfunction for any purpose. “Print media” can be a usually flimsy physicalsheet of paper, plastic, or other suitable physical print mediasubstrate for images. A “print job” or “document” is normally a set ofrelated sheets, usually one or more collated copy sets copied from a setof original print job sheets or electronic document page images, from aparticular user, or otherwise related. As used herein, the term“consumable” refers to anything that is used or consumed by an imagingdevice during operations, such as print media, marking material,cleaning fluid, and the like. An image generally may include informationin electronic form which is to be rendered on the print media by theimage forming device and may include text, graphics, pictures, and thelike. The operation of applying images to print media, for example,graphics, text, photographs, etc., is generally referred to herein asprinting or marking.

As used herein an “action” generally refers to an individual occurrencein which a user interacts with a device by performing a mechanicaloperation, e.g., opening a door of the printer or manipulating, e.g.,pulling out, a component of the printer. In general, actions are thesmallest operations which can be recognized by the printer. Actionswhich may be recorded by the printer include those which are associatedwith a recovery event and those which are associated with normaloperation of the printer. A “recovery action” refers to any action of auser associated with a printer with the object of clearing or preventinga fault with the imaging device. Exemplary user recovery actions introubleshooting include opening access panels to paper trays, removingand/or replacing components such as toner cartridges, adjustingcomponents, removing trapped paper, and the like. The recovery actionsmay take place in response to a printer request or may be userinitiated.

As used herein a replaceable module or “customer replaceable unit” (CRU)can be any component of a printer which has an expected lifetime, untilrepair or replacement, which is shorter than the expected or actuallifetime of the printer in which it is to be used, or which has adesignated lifetime. Generally, CRUs are self-contained, modular unitswhich are easily replaced by a customer, often by simply removing theold CRU and plugging in a new one in the same location. Exemplary CRUsinclude imaging units and fuser units, although CRUs are not limited tothese components and may include other components of a printer or even asubcomponent of a CRU, such as feed roll cartridges, fuser webs,stripper fingers, toner cartridges, developer housings, ozone filters,hole punch heads in the finisher, and the like.

Referring now to FIG. 1, an embodiment of an imaging device 10 of thepresent disclosure, is depicted. As illustrated, the device 10 includesa frame 11 to which are mounted directly or indirectly all its operatingsubsystems and components, as described below. In the embodiment of FIG.1, imaging device 10 is an indirect marking device that includes anintermediate imaging member 12 that is shown in the form of a drum, butcan equally be in the form of a supported endless belt. The imagingmember 12 has an image receiving surface 14 that is movable in thedirection 16, and on which phase change ink images are formed. A heatedtransfix roller 19 rotatable in the direction 17 is loaded against thesurface 14 of drum 12 to form a transfix nip 18, within which ink imagesformed on the surface 14 are transfixed onto a media sheet 49. Inalternative embodiments, the imaging device may be a direct markingdevice in which the ink images are formed directly onto a receivingsubstrate such as a media sheet or a continuous web of media.

The imaging device 10 also includes an ink delivery subsystem 20 thathas at least one source 22 of one color of ink. Since the imaging device10 is a multicolor image producing machine, the ink delivery system 20includes four (4) sources 22, 24, 26, 28, representing four (4)different colors CYMK (cyan, yellow, magenta, black) of ink. The inkdelivery system is configured to supply ink in liquid form to aprinthead system 30 including at least one printhead assembly 32. Sincethe imaging device 10 is a high-speed, or high throughput, multicolordevice, the printhead system 30 includes multicolor ink printheadassemblies and a plural number (e.g. four (4)) of separate printheadassemblies (32, 34 shown in FIG. 1).

In one embodiment, the ink utilized in the imaging device 10 is a“phase-change ink,” by which is meant that the ink is substantiallysolid at room temperature and substantially liquid when heated to aphase change ink melting temperature for jetting onto an imagingreceiving surface. Accordingly, the ink delivery system includes a phasechange ink melting and control apparatus (not shown) for melting orphase changing the solid form of the phase change ink into a liquidform. The phase change ink melting temperature may be any temperaturethat is capable of melting solid phase change ink into liquid or moltenform. In one embodiment, the phase change ink melting temperate isapproximately 100° C. to 140° C. In alternative embodiments, however,any suitable marking material or ink may be used including, for example,aqueous ink, oil-based ink, UV curable ink, or the like.

As further shown, the imaging device 10 includes a media supply andhandling system 40. The media supply and handling system 40, forexample, may include sheet or substrate supply sources 42, 44, 48, ofwhich supply source 48, for example, is a high capacity paper supply orfeeder for storing and supplying image receiving substrates in the formof cut sheets 49, for example. The substrate supply and handling system40 also includes a substrate or sheet heater or pre-heater assembly 52.The imaging device 10 as shown may also include an original documentfeeder 70 that has a document holding tray 72, document sheet feedingand retrieval devices 74, and a document exposure and scanning system76.

Operation and control of the various subsystems, components andfunctions of the machine or printer 10 are performed with the aid of acontroller or electronic subsystem (ESS) 80. The ESS or controller 80for example is a self-contained, dedicated mini-computer having acentral processor unit (CPU) 82, electronic storage 84, and a display oruser interface (UI) 86. The ESS or controller 80 for example includes asensor input and control system 88 as well as a pixel placement andcontrol system 89. In addition the CPU 82 reads, captures, prepares andmanages the image data flow between image input sources such as thescanning system 76, or an online or a work station connection 90, andthe printhead assemblies 32, 34, 36, 38. As such, the ESS or controller80 is the main multi-tasking processor for operating and controlling allof the other machine subsystems and functions, including the printheadcleaning apparatus and method discussed below.

In operation, image data for an image to be produced are sent to thecontroller 80 from either the scanning system 76 or via the online orwork station connection 90 for processing and output to the printheadassemblies 32, 34, 36, 38. Additionally, the controller determinesand/or accepts related subsystem and component controls, for example,from operator inputs via the user interface 86, and accordingly executessuch controls. As a result, appropriate color solid forms of phasechange ink are melted and delivered to the printhead assemblies.Additionally, pixel placement control is exercised relative to theimaging surface 14 thus forming desired images per such image data, andreceiving substrates are supplied by any one of the sources 42, 44, 48along supply path 50 in timed registration with image formation on thesurface 14. Finally, the image is transferred from the surface 14 andfixedly fused to the copy sheet within the transfix nip 18.

To facilitate transfer of an ink image from the drum to a recordingmedium, a drum maintenance system 56, also referred to as a drummaintenance unit (DMU), is provided to apply release agent to thesurface 12 of the print drum 16 before ink is ejected onto the printdrum. Release agent is typically silicone oil that is applied to theprint drum by an applicator roll (not shown) in the drum maintenancesystem that may be partially submerged in a release agent sump. A blade(not shown) may be positioned at a location following the drummaintenance system to remove excess release agent from the print drum.The release agent provides a thin layer on which an image is formed sothe image does not adhere to the print drum. In one embodiment, the drummaintenance system 56 comprises a CRU, and, therefore, is configured forinsertion into and removal from the imaging device as a self-containedunit.

In various modes of operation, ink may be purged from the printheads toensure proper operation of the printhead. When ink is purged through theprinthead, the ink flows down and off the front face of the printhead.Commonly, during a cleaning cycle, a scraper or wiper blade (not shown)may also be drawn across the ink ejecting front face of the printhead tosqueegee away any excess liquid phase ink that may collect there. Thewaste ink wiped-off or otherwise removed from the face of the printhead(typically, still in liquid from) is caught by a gutter, for example,which channels or otherwise directs it toward a removable waste inkcollection container 54 where, e.g., it is allowed to cool andre-solidify. Suitably, the waste ink collection container 54 ispositioned in a location conveniently accessible, e.g., at or near theoutside of the main housing 11 of the device 10. Accordingly, when full,the container 54 is readily removed for disposal of the waste ink fromthe container. Alternately, the full container 54 may simply be disposedof and replaced with a new empty container.

As mentioned, imaging devices, such as the one described above, may besubject to various faults which impact system operation. The term“fault” refers to an abnormal condition or defect at the componentequipment, or sub-system level which may lead to a failure, anaccidental condition that causes a electronic system or portion thereofto fail to perform its intended function or a defect that causes areproducible malfunction (i.e., a malfunction that occurs reproduciblyunder the same conditions). For example, fault conditions that may occurin the imaging device of FIG. 1 include media jams at various locationsin the substrate supply and handling system, consumable depletion (e.g,media, solid ink sticks), CRU's (e.g., drum maintenance unit) requiringreplacement, waste ink tray being full, access panels being open, andthe like.

Referring now to FIG. 2, in order to detect and identify the locationand nature of fault conditions within the imaging device, the imagingdevice includes a fault management system 100 that includes a faultcontroller 104, a sensor system 108, a memory 110 and a user interfacedisplay 114. The fault controller may be implemented as a subsystem ofthe system controller 80. The fault management system includes a sensorsystem 108 that includes a plurality of sensors and devices thatgenerate signals that are output to the fault controller that areindicative of the status of a device component, the presence or absenceof a media at a particular location in the device at a certain time, theavailable media in a media supply source, the available ink in an inksupply source, and the like. Based on the signals received from thesensor system, the fault controller 104 can identify one or more faultconditions and/or fault codes in the imaging device. For example, eachfault condition may have a pre-assigned or predetermined “fault code.”Fault codes, however, may take any format that is capable of conveyingmeaning to the fault controller or operator of the device. In oneapproach, fault codes are alphanumeric character strings whereinparticular characters or groups of characters in the string may beassociated with particular locations, error conditions, replacementcomponents, etc. of an imaging device.

Once a fault code is identified, the fault controller 104 is configuredto actuate the user interface 114 to display fault clearanceinstructions to assist or guide an operator in interacting with animaging device to clear fault conditions, e.g., reload consumables,replace CRUS's, remove jammed paper from the media supply and handlingsystem, close doors, etc. In some previously known systems, instructionsfor clearing faults in an imaging device were in the form of textmessages indicating the source of the fault and/or one or multiple stillimages depicting the section of the device in need of attention thatwere provided, for example, on the exterior surface of the imagingdevice or on a user interface display screen. Still images werepresented to the user comic strip style or presented one after another(e.g., in gif format). While still images may be sufficient for simplefaults such as an out-of-paper condition, they may not be adequate formore complicated faults such as a paper jam in the substrate supply andhandling system 50 of an imaging device, such as the device of FIG. 1.Clearing such a fault may require multiple steps such as: opening adoor, turning a lever clockwise, pulling out a mechanism, lifting acover, etc. Such a sequence of steps is difficult for an operator tofollow even when multiple still images are provided to illustrate eachstep because the images do not convey information about the movementsrequired to accomplish the task.

Another approach that has been utilized to provide fault clearinginstructions to an operator is the use of live-action videos depictingan operator interacting with the imaging device in a prescribed mannerintended to remediate, or clear, the fault condition. Live-actioninstructional videos may be effective in assisting an operator ininteracting with an imaging device. However, in considering the use oflive-action footage for directing users in interacting with an imagingdevice, a number of issues were found that made the use of live-actionvideos unwieldy and expensive. For example, the production oflive-action videos may be expensive due to the multiple people, e.g.actors, camera people, etc., the use of a particular locale,pre-production tasks such as story-boarding, filming the video,post-production tasks such as editing, that are involved. In addition,as an iterative process, where instruction is story-boarded, a sequenceis produced, implemented and then validated in usability testing,changes are likely to be made to an instruction after the initialdelivery—to refine and enhance the clarity of the instruction based onuser feedback. The use of live action video would require that theentire instruction be recreated in order to account for changes in faultclearance methodology. In addition, there are many details of imagingdevice operation that are not easily captured in a live-action video,such as the way baffles snap open, or crash down, renditions of media,such as paper, and how it crumples, for example. Thus, live-actionvideos may still have to undergo significant editing after the video hasbeen captured to add graphical overlays and the like to the videos sothat a user can understand what's going on the video and be able tofollow its instructions.

As an alternative or in addition to the use of text based instructions,cartoons, and still frame images to guide a user in interacting with theimaging device, the present disclosure proposes fault clearanceinstructions implemented using three-dimensional (3D) computer graphics,also known as computer generated imagery (CGI). CGI is the applicationof the field of computer graphics or, more specifically, 3D computergraphics to special effects in films, television programs, commercials,simulators and simulation generally. CGI fault clearance instructionsdepict recovery actions, such as access panels opening, removal andreplacement of components (e.g., CRU's), loading of consumables, removalof jammed paper, and the like, that may be displayed on the userinterface display screen. CGI instruction sequences may be displayed inresponse to the detection of a fault or impending fault condition in theimaging device or may be initiated in response to a user request throughthe user interface.

The use of CGI instruction sequences to guide a user's interactions withan imaging device has numerous advantages over previously known systems.For example, CGI instructions may be depicted from a viewpoint thatcorresponds to the approximate point of view a user would have inphysically performing the recovery action depicted in the instruction.In one embodiment, the viewpoint in each CGI instruction sequence startsfrom a user's perspective at the front of the device, for example, andmoves as a user's point of view would move, panning around the imagingdevice to particular locations, focusing on specific tasks, and zoomingin to specific features, thus guiding a user's attention as if the userwas performing the action themselves. To improve the clarity of theactions depicted in a CGI instruction, extraneous detail may be removedor deemphasized. For example, CGI instructions may depict themanipulation of imaging device levers, doors, components, consumables,and the like, without depicting a user actually performing themanipulation which may decrease the clarity or interfere with the viewof a particular action. Similarly, CGI instructions may be tailored foruse with a specific imaging device configuration so that theinstructions display only the parts and components of the imaging devicethat a user actually has.

To further enhance the clarity of a CGI instruction, movement of theimaging device components, parts, consumables, CRU's, and the like, maybe characterized using motion blur effects. Motion blur is the apparentstreaking of rapidly moving objects in a still image or a sequence ofimages that is caused by, for example, a camera shutter remaining openfor a period of time and the integration of the movement of objects inthe image(s) over that period of time. In CGI, motion blur effects mayused to simulate the visual effect of motion so that images or sequencesof images appear as if they were conventionally photographed or filmed.Any of a number of methods may be utilized to incorporate motion blureffects into a CGI instruction. For example, motion blur effects may becreated by evaluating the positions of all of the objects in an image atslightly different times and then combining and rendering the results.To control the degree of motion blur, time intervals between images in asequence may be specified that is analogous to the exposure time of aconventional camera.

Another advantage of the use of CGI for fault clearance instructions isthat CGI may be used to depict information that is not readilyobservable in the real world, such as the way baffles snap open, orcrash down, renditions of media, such as paper, and how it crumples, forexample. In addition, CGI enables the incorporation of visual indicatorsinto an instruction to, for example, direct a user's attention to anarea of interest such as a component or part of an imaging device aswell as to indicate a direction of motion of a moving part. For example,visual indicators in the form of arrows may be used to indicate requireduser actions, such as turning levers, or moving latches, and ultimately,removing jammed sheets. Arrows may be used to indicate components, suchas CRU's, that need to be removed from the machine (and the actionsnecessary to empty or replace the unit). In the case of the DMU (drummaintenance unit), for example, where there are specific concerns overthe silicone oil content of the unit, the demonstrated care of the unit,potentially imparts to the user the best handling practices (likekeeping upright, placing straight into a box) for the task. Similarly,highlighting, such as by changing the color or shade, of an imagingdevice component, consumable, moving part, and the like, may be utilizedto direct and focus a user's attention. Visual indicators may takesubstantially any format that is capable of enhancing the ability of theinstruction in directing a user's attention or guiding a user's action.

FIGS. 4-8 depict still images from exemplary CGI instructions that maybe utilized in an imaging device, such as the imaging device of FIG. 1.In particular, FIGS. 4A-C are stills from a CGI instruction for removinga media sheet from a particular location in the imaging device. Asdepicted in FIG. 4A, the virtual viewpoint begins from a perspective atthe front of the device 10 that a user might have upon approach to thedevice. The virtual viewpoint is then panned and zoomed in subsequentframes until it is focused an area of interest which in this casecorresponds to a media jam location as depicted in FIG. 4B. FIG. 4C is astill from the instruction that shows the removal of the jammed media 62from the jam location. A visual indicator in the form of an arrow 120 isused to indicate the direction of removal of the jammed sheet from thejam location. FIG. 5 is a still image from a CGI instruction forinserting a yellow ink stick 124 into the imaging device 10. Althoughnot depicted, the CGI instruction for inserting a yellow ink stick intothe imaging device may begin with a viewpoint of the imaging device suchas depicted in FIG. 4A, and continue by showing, for example, a changeink in viewpoint to the ink stick insertion area, the access panel tothe ink stick insertion area opening, and a yellow ink stick beingremoved from its packaging. As seen in FIG. 5, the CGI instructiondepicts the correct insertion opening 128 through which yellow inksticks are inserted as well as the correct orientation and direction ofinsertion (indicated by arrow 130). FIG. 6 is a still image from a CGIinstruction for removing and emptying the waste ink tray 54 (FIG. 1)that shows the direction of removal (indicated by arrow 134) as well asa container 138 into which the waste ink may be emptied.

In addition to the use of visual indicators, such as arrows andselective highlighting, the present disclosure also proposes the use ofcomputer generated imagery (CGI) hands in the fault clearanceinstructions. CGI hands comprise computer generated or rendered imagesof a virtual hand that performs or mimics a users actions in a CGIinstruction such as, opening doors, loading of consumables, turninglevers, removing jammed sheets, and the like, that the user can thenmimic, the most natural form of instruction possible, as if the userwere watching a demonstration from another person. The use of CGI handsoffers users the chance to pick up on subtle movements that are requiredto complete tasks easily in areas with limited space constraints thatmay not otherwise be possible using live-action video. In addition, CGIhands may be rendered so as to be substantially transparent so as not toobstruct the view of the action being performed. The coloring and/orshape of CGI hands may be selected so as to be gender and race neutral.FIGS. 7 and 8 are still images from exemplary CGI clearance instructionsthat show CGI hands 150. FIG. 7 is a still image of an instruction forloading black ink into an imaging device and shows a CGI hand 150 in theact of inserting a black ink stick into the appropriate black ink stickopening. As can be seen in FIG. 7, the CGI hand is substantiallytransparent so that it does not interfere with the view of the insertionopenings or ink stick. FIG. 8 is a CGI instruction forremoval/replacement of staples in a finishing system of the imagingdevice and shows a CGI hand 150 in the act of grasping and squeezing astaple cartridge 152. As depicted in FIGS. 7 and 8, CGI hands may beused in conjunction with other virtual indicators such as arrows 134 tofurther enhance the clarity of the actions to be performed. For example,the arrows 134 of FIG. 8 demonstrate the squeezing action required torelease the staple cartridge from its slot in the device.

FIG. 3 depicts an embodiment of a method of generating or developing CGIfault clearance instructions for use with an imaging device, such as theimaging device of FIG. 1. The method begins with the generation of athree-dimensional (3D) model of the imaging device in a 3D computergenerated environment, also referred to as a 3D space (block 300). Asused herein, a 3D model comprises data that describes athree-dimensional object, e.g., imaging device 10, with reference to the3D space. A 3D model of the imaging device may be generated in anysuitable manner. For example, 3D models may be generated using any knownor as yet undeveloped 3D modeling software. Several techniques are knownfor creating a model using software applications. Such techniquesinclude, but are not limited to: combining primitives, extruding,lofting, box modeling, facet modeling, constructive solid geometry,parametric based modeling and combinations thereof.

Once the 3D model of the imaging has been developed, CGI instructionsmay be generated using the model. Each CGI instruction comprises asequence of computer generated images, also referred to as frames. The3D model of the imaging device is translated into a sequence of computergenerated frames using a process known as rendering (block 304).Rendering may be performed using a suitable rendering software and/orhardware package, and involves translating the three-dimensional datathat describes the imaging device in the 3D computer space into a formthat can be displayed in a two-dimensional display device such as userinterface display screen. CGI instructions may be rendered into anydesired machine-readable format that is capable of being displayed onthe display screen. The sequence of rendered frames of a CGI instructionis configured for display at a predetermined frame rate, e.g., framesper second. To give the viewer an impression of smooth, continuousmotion, CGI instruction frames may be displayed at a frame rate of atleast 25 frames per second although any suitable frame rate may be used.

During rendering, parameters such as lighting effects, shade, color,surface textures, perspective and other visual elements, are defined inorder to create a convincingly “3D” image on the flat display screen. Inaddition, each frame in a CGI instruction is rendered from apredetermined virtual viewpoint as defined in the 3D model space. Asmentioned, the virtual viewpoint in a CGI instruction may correspond toa viewpoint that a user may have in physically performing an actiondepicted in an instruction. Thus, the virtual viewpoint may be assigneda path of motion from frame to frame to simulate a user's point of view.Also, depending on the condition that a particular CGI instruction isintended to address, paths of motion for imaging device components, suchas switches, levers, doors, CRU's, etc., may be specified from frame toframe during the rendering process to demonstrate actions that are to beperformed by a user.

Some CGI instructions may require the addition of 3D objects to the 3Dmodel that are external to or separate from the 3D model of the imagingdevice. For example, CGI instructions may depict the handling, loading,and/or removal of CRU's and consumables. In such CGI instructions, 3Dobjects corresponding to consumable items or CRU's may be added to the3D model prior to or during the rendering process for the instructionsand paths of motion from frame to frame may be defined for the objectsthat depict, for example, how to correctly load media or ink sticks intothe imaging device and how to remove and replace a CRU. In addition toconsumable and/or CRU objects, objects corresponding to visualindicators, such as arrows, CGI hands, and their respective paths ofmovement, may be defined for certain frames or sequences of frames toindicate the required user actions, like turning levers, moving latches,direction of insertion or removal of CRU's, direction and orientationfor inserting consumables, etc.

A plurality of CGI instructions may be rendered in this manner from the3d model of the imaging device with each CGI instruction depicting oneor more actions to be taken by a user to address a particular faultcondition. In one embodiment, each CGI instruction is assigned tocorrespond to one or more fault codes and is configured for playback onthe display screen in response to the detection of the fault code. Morethan one CGI instruction may be associated with a particular fault codewith each CGI instruction for the fault code being prioritized forplayback based on, for example, prior success rates or user feedback.Once one or more CGI instructions have been rendered from the 3D model,the CGI instructions may be stored in a memory 110 (FIG. 2) associatedwith the imaging device (block 308). The memory may be implemented usingany appropriate combination of alterable, volatile or non-volatilememory or non-alterable, or fixed, memory, and may be internally and/orexternally located with respect to the imaging device. In oneembodiment, CGI instructions may be stored in the memory in aninstruction database. Each CGI instruction may be stored in theinstruction database in association with at least one fault code. Thefault codes may be used as a lookup key for accessing the instructiondatabase to retrieve one or more CGI instructions stored in associationwith each fault code.

A user interface display screen 114 (FIG. 2) is then configured toselectively display the stored CGI instructions (block 310) to assist orguide an operator in interacting with an imaging device to, for example,open or close doors, remove or replace CRU's, load consumables, andotherwise use the device. CGI instructions may be displayed in responseto the detection and identification of fault conditions or fault codesin the imaging device. CGI instructions may also be displayed inresponse to requests made via controls on the user interface. Referringto FIG. 2, display device 114 may be any suitable type of display devicecapable of displaying CGI instructions. For example, display device 114may be a liquid crystal display (LCD) panel, a thin film transistorliquid crystal display (TFT LCD) panel, a plasma display panel (PDP), afield emission display (FED) panel, a surface-conductionelectron-emitter display (SED) panel, a touch screen display panel, acathode ray tube (CRT) display panel, an organic light-emitting diode(OLED) display panel and/or any combination thereof. The display deviceincludes any necessary hardware or software that enables the displaydevice to play the retrieved fault clearance instruction at thepredetermined frame rate and in accordance with any other desiredviewing preferences.

Turning now to FIG. 9, an embodiment of a user interface display screen114 is shown. In one embodiment, fault clearance instructions aredisplayed on the display screen in a fault frame 140 that may appearover existing user interface dialogue when a fault occurs. As depictedin FIG. 9, the fault frame 140 includes a 3D graphics window 144 fordisplaying a CGI instruction sequence. The selection of CGI instructionsto be played in the graphics window 140 may be made automatically by thefault controller 104 in response to the detection of a fault orimpending fault condition or may be made in response to a user requestvia the user interface 86 (FIG. 1). The fault frame 140 may includecontrols (not shown) configured to provide a user with the capability tocontrol the display of the instruction such as by stopping, pausing,fast forwarding, rewinding, etc. The fault frame may also include a textwindow 148 for displaying a second level of instruction in the form ofinstructional text. For example, as seen in FIG. 9, an enumerated listof fault clearance steps that correspond to the actions being depictedin the graphics window may be provided in the text window 148. In theexemplary fault frame of FIG. 9, the CGI instruction depicted is a drummaintenance unit (i.e., cleaning unit) replacement instruction. Thestill image of the instruction depicted in the graphics window 144 showsthe removal of the old unit from the device.

It will be appreciated that various of the above-disclosed and otherfeatures, and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Variouspresently unforeseen or unanticipated alternatives, modifications,variations, or improvements therein may be subsequently made by thoseskilled in the art, which are also intended to be encompassed by thefollowing claims.

1. A method of providing instructions to a user of an imaging device,the method comprising: generating a three-dimensional (3D) model ofmachine in a 3D computer generated environment; rendering a plurality ofcomputer generated imagery (CGI) instruction sequences from the 3Dmodel, each CGI instruction sequence depicting at least one action beingperformed on the machine in response to a fault condition of themachine, the CGI instruction sequence being rendered from a virtualviewpoint corresponding to a viewpoint of a user physically performingthe at least one action; storing each CGI instruction sequence in amemory of the machine in association with at least one fault code;identifying a fault condition in the machine; correlating the identifiedfault condition with a fault code; accessing the memory to retrieve theCGI instruction sequence stored in association with the fault codecorrelated to the identified fault condition; and displaying on adisplay screen of the machine the identification of the fault conditionin the machine and the CGI instruction sequence stored in associationwith the fault code correlated to the identified fault condition.
 2. Themethod of claim 1, the display of the CGI instruction sequence furthercomprising: providing a fault frame on the user interface displayscreen, the fault frame including a 3D graphics window; and displayingthe CGI instruction sequence in the 3D graphics window.
 3. The method ofclaim 2, the provision of the fault frame further comprising: providingthe fault frame with a text window in addition to the 3D graphicswindow; and displaying instruction text in the text window thatcorresponds to the CGI instruction sequence being displayed in the 3Dgraphics window.
 4. The method of claim 1, the rendering of the CGIinstruction sequence further comprising: rendering the CGI instructionsequence from the 3D model, the CGI instruction sequence depicting atleast one action being performed on the machine by a CGI hand.
 5. Afault management system for use with a machine, the fault managementsystem including: a memory; a plurality of computer generated imagery(CGI) instruction sequences stored in the memory in association with afault condition, each CGI instruction sequence being rendered from a 3Dmodel of a machine defined in a 3D computer generated environment anddepicting at least one action being performed on the machine, each CGIinstruction sequence being rendered from a virtual viewpoint in the 3Denvironment corresponding to a viewpoint of a user physically performingthe corresponding action and each CGI instruction sequence comprising aplurality of computer generated frames, each frame in the plurality offrames including a rendered image of at least a portion of the 3D modelof the machine, motion being depicted in a CGI instruction sequence bychanging a position of at least one of movable component of the machinefrom frame to frame in the sequence; a user interface display screenoperably coupled to the memory and configured to display the pluralityof CGI instruction sequences; a sensor system configured to generatesignals indicative of a status of the machine; and a fault controlleroperably coupled to the sensor system, the memory and the displayscreen, the fault controller being configured to receive the signalsgenerated by the sensor system and to identify fault conditions in themachine with reference to the signals, to access the memory to retrievethe at least one CGI instruction sequence stored in the memory inassociation with a fault condition identified by the fault controller,and to actuate the display screen to display the at least one retrievedCGI instruction sequence.
 6. The system of claim 5 wherein the motionbeing depicted in each CGI instruction sequence uses computer generatedmotion blur.
 7. The system of claim 6, the plurality of frames of a CGIinstruction sequence being configured for display on the display screenat a predetermined frame rate.
 8. The system of claim 7, thepredetermined frame rate being at least 25 frames per second.
 9. Amethod of operating an imaging device, the method comprising: detectinga fault condition in a machine; correlating the detected fault conditionto a fault code; accessing a memory to retrieve at least one CGIinstruction sequence stored in the memory in association with the faultcode correlated to the detected fault condition; and displaying theretrieved at least one CGI instruction sequence on a display screen inresponse to the detection of the fault condition, each CGI instructionsequence being rendered from a 3D model of the machine defined in a 3Dcomputer generated environment and depicting at least one action beingperformed on the machine, each CGI instruction sequence being renderedfrom a virtual viewpoint in the 3D environment corresponding to aviewpoint of a user physically performing the corresponding action. 10.The method of claim 9, the display of the CGI instruction sequencefurther comprising: providing a fault frame on the user interfacedisplay screen, the fault frame including a 3D graphics window; anddisplaying the retrieved at least one CGI instruction in the 3D graphicswindow.
 11. The method of claim 10, the provision of the fault framefurther comprising: providing the fault frame with a text window inaddition to the 3D graphics window; and displaying instruction text inthe text window that corresponds to the CGI instruction sequence beingdisplayed in the 3D graphics window.